Program Evaluation Overview

Principles

Definition

Program evaluation is a systematic research field and methodological approach dedicated to assessing the design, implementation, and outcomes of interventions, policies, or initiatives, commonly referred to as 'programs'. It investigates questions concerning a program's relevance, efficiency, effectiveness, impact, and sustainability by rigorously collecting and analyzing qualitative and quantitative data using various research designs. Its significance lies in providing evidence-based judgments to inform decision-making, improve program performance, ensure accountability to stakeholders, and contribute to the theoretical and practical understanding of social and organizational change efforts.

Ontological type

Key Approaches

Core Purposes

Research Designs

Key developments

Key Figures

Measurement and Validity Foundations era

Michael Quinn Patton[1] is associated with the University of Minnesota[3] and the University of Minnesota System[4] in this era of measurement and validity foundations. His key contribution is the introduction of Qualitative Evaluation Methods[7], which helped operationalize constructs and generate reliable indicators, thereby expanding interpretive conventions and methodological toolkit in this era. Robert E. Stake[2] is associated with the University of Illinois Urbana-Champaign[5] and Urbana University[6] in this era. His influential contribution is The Countenance of Educational Evaluation[8] (1967), which articulated foundational perspectives on the purpose and interpretation of educational evaluation and guided subsequent emphasis on evaluation frameworks during this era.

Theory and Stakeholder Utilization era

Gordon Guyatt [1], affiliated with Harvard University [3] and the University of California, San Francisco [4], emerged as a leading figure in the Theory and Stakeholder Utilization era. The 2004 paper Grading quality of evidence and strength of recommendations [6] introduced a standardized framework for judging evidence and guiding recommendations, supporting theory-driven and utilization-focused evaluation in this era. Holger J. Schünemann [2], affiliated with Harvard University [3] and the University of Toronto [5], contributed to the Grading quality of evidence and strength of recommendations [6] as a co-author. This 2004 paper [6] advanced transparent, graded evidence and explicit recommendations, strengthening the alignment of theory-based causal models with stakeholder-utilization practices in education and organizational evaluation.

Benchmarking and Standardized Accountability era

Laurence Moore [1] is associated with institutions such as Oregon Health & Science University [3] and University of Glasgow [4] during this era. His contribution centers on process evaluation of complex interventions, as detailed in Process evaluation of complex interventions: Medical Research Council guidance [7], providing standardized evaluation methods that strengthened reliability and cross-study comparability—key pillars for benchmarking in this era. Paul Black [2] is linked to institutions such as Columbia University [5] and University College London [6] in this era. His key contribution lies in developing the theory of formative assessment, as articulated in Developing the theory of formative assessment [8] (2009), which underpins standardized assessment practices that support comparability and transferability in program evaluation.